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WE CLAIM: 

1 1 . A method for determining whether a pixel lies on an edge of a digital image, 

2 said method comprising: 

3 determining, for said pixel, a first edge-orientation of a first color and a second 

4 edge-orientation of a second color; and 

5 providing respective interpolation votes associated with said first edge- 

6 orientation and said second edge-orientation to determine a selected interpolation orientation, 

7 said respective interpolation votes being either a first interpolation orientation or a second 

8 interpolation orientation, said selected interpolation orientation being based on the number of 

9 said interpolation votes for said first interpolation orientation and said second interpolation 
10 orientation. 

1 2. The method of Claim 1, wherein said first and second edge-orientations are 

2 first and second gradients, respectively, said first and second gradients forming a Jacobian of 

3 said pixel. 



DALLAS2 785329v3 47429-00043 



-35- 



Patent Application 
Attorney Docket No. 1 00 1 0667- 1 
(47429-00043) 

1 3. The method of Claim 2, wherein said first interpolation orientation is a 

2 horizontal interpolation and said second interpolation orientation is a vertical interpolation, 

3 and wherein said step of providing further comprises: 

4 setting a first one of said interpolation votes associated with said first gradient, 

5 said first interpolation vote being set as said horizontal interpolation when the absolute value 

6 of a row component of said first gradient is lower than the absolute value of a column 

7 component of said first gradient, said first interpolation vote being set as said vertical 

8 interpolation when the absolute value of said column component of said first gradient is lower 

9 than the absolute value of said row component of said first gradient; 

10 setting a second one of said interpolation votes associated with said second 

1 1 gradient, said second interpolation vote being set as said horizontal interpolation when the 

12 absolute value of a row component of said second gradient is lower than the absolute value of 

13 a column component of said second gradient, said second interpolation vote being set as said 

14 vertical interpolation when the absolute value of said column component of said second 

1 5 gradient is lower than the absolute value of said row component of said second gradient; and 

16 selecting either said horizontal interpolation, said vertical interpolation or a 

17 combination of said vertical interpolation and said horizontal interpolation for said selected 

1 8 interpolation orientation based on said steps of setting. 
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1 4. The method of Claim 3, wherein said step of selecting further comprises: 

2 providing neighborhood vote data, said neighborhood vote data including a 

3 majority vote from at least one adjacent pixel, said majority vote being horizontal interpolation 

4 when the majority of said interpolation votes from said adjacent pixel are horizontal 

5 interpolation and vertical interpolation when the majority of said interpolation votes from said 

6 adjacent pixel are vertical interpolation; and 

7 adding said neighborhood vote data to said interpolation votes to determine 

8 said selected interpolation orientation. 

1 5. The method of Claim 4, wherein said step of selecting further comprises: 

2 setting at least a first threshold and a second threshold associated with the 

3 number of said interpolation votes for either said horizontal interpolation or said vertical 

4 interpolation; and 

5 selecting said combination of said vertical and horizontal interpolations as said 

6 selected interpolation orientation when the number of said interpolation votes for either said 

7 horizontal interpolation or said vertical interpolation falls in between said first and second 

8 thresholds. 
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1 6. A method for demosaicing a digital image represented as values at pixel 

2 locations, said method comprising: 

3 receiving a set of first color values and a set of said second color values; 

4 determining for a given one of said first color values associated with a given 

5 one of said pixel locations a first degree of change using said set of first color values and a 

6 second degree of change using said set of second color values, said first and second degrees of 

7 change each having a row component and a column component; 

8 comparing said row component to said column component for both said first 

9 and second degrees of change to determine a selected interpolation orientation. 

1 7. The method of Claim 6, further comprising: 

2 interpolating a missing second color value associated with said given pixel 

3 location using said selected interpolation orientation. 

1 8. The method of Claim 7, wherein said step of interpolating further comprises: 

2 interpolating said missing second color value by applying a linear prediction 

3 function that uses said first color values and said second color values. 
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1 9. The method of Claim 8, wherein said step of interpolating further comprises: 

2 determining a number of said first and second color values that are below a 

3 low-light threshold value; and 

4 turning off said linear prediction function when said number exceeds an 

5 additional threshold value. 



1 10. The method of Claim 7, further comprising: 

2 determining a difference value by subtracting said interpolated missing second 

3 color value from said given first color value; and 

4 interpolating a missing first color value using at least said difference value, said 

5 missing first color value being associated with one of said pixel locations that did not produce 

6 said first color value. 
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1 11. The method of Claim 6, wherein said first and second degrees of change are 

2 first and second gradients, respectively, said first and second gradients forming a Jacobian of 

3 said given first color value, and wherein said step of comparing further comprises: 

4 supplying, by each of said first and second gradients, a respective interpolation 

5 vote, said interpolation vote being either a first interpolation orientation or a second 

6 interpolation orientation, said selected interpolation orientation being based on the number of 

7 said interpolation votes for said first interpolation orientation and said second interpolation 

8 orientation. 
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1 12. The method of Claim 11, wherein said first interpolation orientation is a 

2 horizontal interpolation and said second interpolation orientation is a vertical interpolation, 

3 and wherein said step of supplying further comprises: 

4 setting said interpolation vote as said horizontal interpolation, by a respective 

5 one of said first and second gradients, when the absolute value of said row component of said 

6 respective gradient is lower than the absolute value of said column component of said 

7 respective gradient; 

8 setting said interpolation vote as said vertical interpolation, by said respective 

9 gradient, when the absolute value of said column component of said respective gradient is 

10 lower than the absolute value of said row component of said respective gradient; and 

1 1 selecting either said horizontal interpolation, said vertical interpolation or a 

12 combination of said vertical interpolation and said horizontal interpolation for said selected 

13 interpolation orientation based on said steps of setting. 
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1 13. The method of Claim 12, wherein said step of selecting further comprises: 

2 providing neighborhood vote data, said neighborhood vote data including a 

3 majority vote from at least one adjacent one of said pixel locations to said given pixel location, 

4 said majority vote being horizontal interpolation when the majority of said interpolation votes 

5 from said adjacent one of said pixel locations are horizontal interpolation and vertical 

6 interpolation when the majority of said interpolation votes from said adjacent one of said pixel 

7 locations are vertical interpolation; and 

8 adding said neighborhood vote data to said interpolation votes to determine 

9 said selected interpolation orientation. 

1 14. The method of Claim 13, wherein said step of selecting further comprises: 

2 setting at least a first threshold and a second threshold associated with the 

3 number of said interpolation votes for either said horizontal interpolation or said vertical 

4 interpolation; and 

5 selecting said combination of said vertical and horizontal interpolations as said 

6 selected interpolation orientation when the number of said interpolation votes for either said 

7 horizontal interpolation or said vertical interpolation falls in between said first and second 

8 thresholds. 
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1 15. The method of Claim 6, wherein said first color values are chrominance color 

2 values and said second color values are luminance color values. 

1 16. The method of Claim 1 5 , further comprising : 

2 determining a first mean luminance value of a first group of said luminance 

3 color values and a second mean luminance value of a second group of said luminance color 

4 values; 

5 determining a difference percentage between said first mean luminance value 

6 and said second mean luminance value; and 

7 increasing said luminance color values of said first group by said difference 

8 percentage when said first mean luminance value is lower than said second mean luminance 

9 value. 
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1 17. The method of Claim 15, further comprising: 

2 determining a Jacobian of a given one of said luminance color values from said 

3 set of luminance color values; 

4 determining a first sum of the absolute values of the values within said 

5 Jacobian; and 

6 if said first sum is less than a predefined threshold: 

7 multiplying said given luminance color value by four, 

8 adding said luminance color values of four diagonally adjacent pixel 

9 locations to obtain a second sum, and 

10 dividing said second sum by eight. 

1 18. The method of Claim 6, further comprising: 

2 determining a Jacobian of said given first color value; 

3 determining a first sum of the absolute values of the values within said 

4 Jacobian; and 

5 if said first sum is less than a predefined threshold: 

6 multiplying said given first color value by eight, 

7 adding said first color values of eight nearest pixel locations to obtain a 

8 second sum, and 

9 dividing said second sum by sixteen. 
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1 19. A digital image system for demosaicing a digital image represented as values at 

2 pixel locations, said system comprising: 

3 a processor adapted to receive a set of first color values and a set of second 

4 color values, said processor being further adapted to determine for a given one of said first 

5 color values associated with a given one of said pixel locations a first degree of change using 

6 said set of first color values and a second degree of change using said set of second color 

7 values, said first and second degrees of change each having a row component and a column 

8 component, said row component being compared to said column component for both said first 

9 and second degrees of change to determine a selected interpolation orientation. 

1 20. The system of Claim 20, wherein said processor is further adapted to 

2 interpolate a missing second color value for said pixel location associated with said given pixel 

3 location using said selected interpolation orientation. 



1 21. The system of Claim 20, wherein said processor is further adapted to 

2 interpolate said missing second color value by applying a linear prediction function that uses 

3 said first color values and said second color values. 
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1 22. The system of Claim 21 , wherein said processor is further adapted to determine 

2 a number of said first and second color values that are below a low-light threshold value, said 

3 processor being further adapted to turn off said linear prediction function when said number 

4 exceeds an additional threshold value. 

1 23. The system of Claim 20, wherein said processor is further adapted to receive a 

2 set of third color values, said sets of first, second and third color values each being associated 

3 with a different color, said processor further being capable of determining a third degree of 

4 change associated with said third color values. 
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1 24. The system of Claim 23, wherein said processor is further adapted to determine 

2 a difference value by subtracting said interpolated missing second color value from said given 

3 first color value and interpolate a missing first color value for said pixel location associated 

4 with said second or third color values using at least said difference value. 

1 25. The system of Claim 23, wherein said first, second and third degrees of change 

2 are first, second and third gradients, respectively, said first, second and third gradients forming 

3 a Jacobian of said given first color value, each of said first, second and third gradients 

4 supplying a respective interpolation vote, said interpolation vote being either a first 

5 interpolation orientation or a second interpolation orientation, said selected interpolation 

6 orientation being based on the number of said interpolation votes for said first interpolation 

7 orientation and said second interpolation orientation. 
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1 26. The system of Claim 25, wherein said first interpolation orientation is a 

2 horizontal interpolation using at least one or more of said second color values from said pixel 

3 locations within the same row of said pixel locations as said given pixel location and said 

4 second interpolation orientation is a vertical interpolation using at least one or more of said 

5 second color values from said pixel locations within the same column of said pixel locations as 

6 said given pixel location, said interpolation vote of a respective one of said first, second and 

7 third gradients being said horizontal interpolation when the absolute value of said row 

8 component of said respective gradient is lower than the absolute value of said column 

9 component of said respective gradient and vertical interpolation when the absolute value of 

10 said column component of said respective gradient is lower than the absolute value of said row 

1 1 component of said respective gradient, said selected interpolation orientation being selected 

12 from the group consisting of: said horizontal interpolation, said vertical interpolation or a 

13 combination of said vertical interpolation and said horizontal interpolation. 
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1 27. The system of Claim 26, farther comprising: 

2 a memory capable of storing neighborhood vote data, said neighborhood vote 

3 data including a majority vote from at least one adjacent one of said pixel locations to said 

4 given pixel location, said majority vote being horizontal interpolation when the majority of said 

5 interpolation votes from said adjacent one of said pixel locations are horizontal interpolation 

6 and vertical interpolation when the majority of said interpolation votes from said adjacent one 

7 of said pixel locations are vertical interpolation, said neighborhood vote data being added to 

8 said interpolation votes to determine said selected interpolation orientation. 

1 28. The system of Claim 27, further comprising: 

2 at least a first threshold and a second threshold associated with the number of 

3 said interpolation votes for either said horizontal interpolation or said vertical interpolation, 

4 said selected interpolation orientation being said combination of said vertical and horizontal 

5 interpolations when the number of said interpolation votes for either said horizontal 

6 interpolation or said vertical interpolation falls in between said first and second thresholds. 

1 29. The system of Claim 19, wherein said first color values are chrominance color 

2 values and said second color values are luminance color values. 
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1 30. The system of Claim 29, wherein said processor is further adapted to determine 

2 a first mean luminance value of a first group of said luminance color values and a second mean 

3 luminance value of a second group of said luminance color values, said processor further being 

4 adapted to determine a difference percentage between said first mean luminance value and said 

5 second mean luminance value and increase said luminance color values of said first group by 

6 said difference percentage when said first mean luminance value is lower than said second 

7 mean luminance value. 

1 31. The system of Claim 29, wherein said processor is further adapted to determine 

2 a Jacobian of a given one of said luminance color values from said set of luminance color 

3 values and determine a first sum of the absolute values of the values within said Jacobian, said 

4 processor being further adapted to multiply said given luminance color value by four, add said 

5 luminance color values of four diagonally adjacent pixel locations to obtain a second sum and 

6 divide said second sum by eight when said first sum is less than a predefined threshold. 

1 32. The system of Claim 19, wherein said processor is further adapted to determine 

2 a Laplacian of a select color value within either said set of first color values or said set of 

3 second color values and add said Laplacian multiplied by an adjustable parameter to said select 

4 color value. 
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1 33. The system of Claim 19, wherein said processor is further adapted to determine 

2 a Jacobian of said given first color value and determine a first sum of the absolute values of the 

3 values within said Jacobian, said processor being further adapted to multiply said given first 

4 color value by eight, add said first color values of eight nearest pixel locations to obtain a 

5 second sum and divide said second sum by sixteen when said first sum is less than a predefined 

6 threshold. 
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